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DETAILED ACTION 

Priority 

1 . Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which 
papers have been placed of record in the file. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

3. Claims 1-3. 5. 6. and 9-16 are rejected under 35 U.S.C. 102(b) as being 
anticipated bv Matsumoto et al. (US 6.229.566 BP. 

4. Regarding claims 1 and 15, Matsumoto et al. disclose an image-taking 
apparatus comprising an image sensor that captures an image (103), an image recorder 
that records an image captured by the image sensor on a recording medium, i.e. a 
storage unit (109), a display that displays an image recorded on the recording medium 
(113), a first selector that selects a mode for adding relevant information to an image 
captured by the image sensor, e.g. a switch (402) for starting the operation of the 
display in order for the user to add any annotations (see col.9, lines 35-37), and a 
second selector, i.e. a pen input device (403) that, when the first selector selects the 
mode for adding relevant information, selects as an image to which to add relevant 
information either an image recorded on the recording medium (see col. 10, lines 36-41 ) 
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or an image that is going to be newly captured by the image sensor (see col. 14, lines 
19-27). 

5. Regarding claims 2 and 16, Matsumoto et al. disclose that the relevant 
information is annotation information, i.e. attribute data (see col. 5, lines 39-45). 

6. Regarding claim 3, Matsumoto et al. disclose that, when the second selector 
selects an image recorded on the recording medium as an image to which to add 
annotation information, i.e. when the user clicks on a contents screen (701), the display 
displays a selection screen for permitting selection of an image to which to add 
annotation information (see figure 9 and col. 10, lines 36-41). 

7. Regarding claim 5, Matsumoto et al. disclose that the selection screen includes 
an image to which to add annotation information and an indication relating to annotation 
information already added thereto (see figure 9). 

8. Regarding claim 6, Matsumoto et al. disclose an operation member, i.e. a pen 
input device (403), operated by a user, and a reproducer, i.e. a display (113), that, when 
the operation member is operated while an image to which to add annotation 
information is being displayed on the display, i.e. when the user clicks with the pen input 
device on the edit tool icon (602), reproduces annotation information already added to 
the image displayed on the display (see figure 9 and col. 10, lines 36-41). 

9. Regarding claim 9, Matsumoto et al. disclose that the annotation information is 
an image that is going to be newly captured by the image sensor, i.e. a differential 
image obtain from the difference between the main image and sub-images taken before 
and after the main image (see col. 15, lines 45-53 and col. 16, lines 1-3). 
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10. Regarding claim 10, Matsumoto et al. disclose a sound recorder, i.e. a 
microphone (4402) and a buffer (4403), that records a sound, wherein the annotation 
information is a sound recorded by the sound recorder (see col. 17, lines 31-48). 

1 1 . Regarding claim 11, Matsumoto et al. disclose that the annotation information is 
added to a region within an image displayed on the display (see col. 10, lines 36-42). 

12. Regarding claim 12, Matsumoto et al. disclose that, as the annotation 
information, different pieces of annotation information are added to a plurality of regions 
within an image displayed on the display (see figure 9). 

13. Method claims 13 and 14 are drawn to the method of using the corresponding 
apparatus claimed in claims 1 and 2. Therefore method claims 13 and 14 correspond to 
apparatus claims 1 and 2 and are rejected for the same reasons of anticipation as used 
above. 

Claim Rejections -35 USC §103 

14. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

15. Claims 4. 7 and 8 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Matsumoto et al. (US 6.229.566 BP. 
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16. Regarding claim 4, as mentioned in the discussion of claims 1-3 above, 
Matsumoto et al. disclose all the limitations of the parent claim. However, Matsumoto et 
al. do not explicitly disclose that, when an image selected as an image to which to add 
annotation information is deleted from the recording medium, the display displays the 
selection screen for permitting selection of an image to which to add annotation 
information. It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to display the selection screen for permitting selection of 
an image to which to add annotation information, if the image selected as an image to 
which to add annotation information is deleted from the recording medium because it 
would have been expected by the user to go back to said selection screen since it 
would have been the last screen displayed. 

17. Regarding claim 7, as mentioned in the discussion of claims 1 above, 
Matsumoto et al. disclose all the limitations of the parent claim. In addition, Matsumoto 
et al. disclose a display controller (112). Matsumoto et al., however, do not explicitly 
teach that, when the second selector selects an image recorded on the recording 
medium as an image to which to add annotation information, the controller displays on 
the display an image selected last time as an image to which to add annotation 
information before permitting selection of an image to which to add annotation 
information. It would have been obvious to one having ordinary skill in the art at the 
time the invention was made to display the last image selected for edition as an image 
to which to add annotation information before permitting selection of an image in order 
to remind the user the last image that was annotated. 
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18. Regarding claim 8, as mentioned in the discussion of claims 1 above, 
Matsumoto et al. disclose all the limitations of the parent claim. In addition, Matsumoto 
et al. disclose a display controller (112). Matsumoto et al., however, do not explicitly 
teach that, when the second selector selects an image recorded on the recording 
medium as an image to which to add annotation information, the controller displays on 
the display an image to which annotation information has already been added as an 
image to which to add annotation information before permitting selection of an image to 
which to add annotation information. It would have been obvious to one having ordinary 
skill in the art at the time the invention was made to display the last image selected to 
which annotation information has already been added as an image to which to add 
annotation information before permitting selection of an image in order to remind the 
user the last image that was annotated. 

Conclusion 

19. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

• Lloyd-Jones et al. (US Pre-Grant Application Publication 2002/0055955 A1 ) 
disclose a method and an apparatus for annotating an image. 

• Mizoguchi (US 5,805,215) discloses a method for generating image data and 
additional data paired with the image data. 
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20. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Wanda M. Negron whose telephone number is (571 ) 
270-1 129. The examiner can normally be reached on Mon-Fri 6:30 am - 4:00 pm 
alternate Fri off. 

21 . If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

22. Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Wanda M. Negron 
February 5, 2007 



DAVID OMETZ 
SUPERVISORY PATENT EXAMINER 




